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DYNAMIC RESOURCE CONTROL IN TELECQMMWtCATaONS NETWORKS 
FIELD OF THE INVENTION 

5 This invention relates to a method and apparatus for Dynamic Resource Control in a 

p, 

telecommunications network and a system inaaporafing ^ same. 

BACKGROUND OF THE INVENTION 1; J- 

10 In all data networks, it is necessary to balance allocation of i-esources (such as 
bandwidth) amongst users. It is also desirable to be able to provide different levels of 
service to different users. This, in consequence, means thai netwwk resources must 
usually be shared unequally between users to provide different levels of service. 

15 Once it is accepted that different users will receive different allocations of resources, it 
then becomes necessary to provide a mechanism which allows interaction between 
users. Such required interaction can make resource control systems computationally 
complex and also limit the ability of a network operator to introduce new resource 
control systems on a piecemeal basis. 

20 

The present invention sets out to produce a relatively simple mechanism for allocating 
resources to users in a network and a mechanism which is scateable and does not 
need to be implemented on a network-wide basis. 

25 SUMMARY OF THE INVENTION 

in accordance with a first aspect of the Invention there is provided a method of 
managing resources in a switched network comprising the steps of assigning a 
respective WtP value to each of a plurality of network users, assigning respective set 

30 point values for a network performance parameter for each of a plurality of routers in 
the network, assigning a respective initial price value to each router v/hich is associated 
with the network performance parameter at the router, and operating a first control loop 
which is operable to receive respective measures of the actual network performance at 
each of the routers, calculate for each router, a plurality of differences values which are 

35 the respective differences between the actual performance and the set point for each 




10 



router, adjust the price value for each router by & factor based on Ite r^pec&* s 

difference value, generate a flow price value for 1 
for each of the routers in the pa* of the respective users iC 
network, allocate a resource share value for each f^$ti§k$i represents the 
the respective WtP value divided by ;flie respect^ jjfctea vafcie,; ^ S| w«^^ 
ingress router for each user to restrict flow into the network ingress from each user in 
accordance with each user's allocated resource share value, ivhereby the actual 
network performance at each router is made to converge to the set point value for the 
respective router by automatic admission control adjustments at the network ingress 
routers. 



Preferably the method also includes assigning respective second &£ point values for a 
second network performance parameter for each of a plurality of routers in the network, 
assigning a respective initial second price value to each router whici is associated with 

15 the second network performance parameter at the router, and further including 
operating a service manager operable to monitor the said convergence of the actual 
network performance with the set point network performance and to provide a 
provisioning potential value to a second control loop, the second control loop being 
operable to receive respective measures of the actual second network performance 

20 parameter at each of the routers, calculate for each router, a plurality of difference 
values which are the respective differences between the actusd second network 
performance parameter and the second set point for each router, adjust the second 
price value for each router by a factor based on the respective; difference value, 
generate a second flow price value for each user by summing the second price values 

25 for each of the routers in the path of the respective user's desired data flow through the 
network, and allocate a second resource share value for each user which represents 
the value of the respective provisioning potential value divided by the respective 
second flow price value, the Ingress router for each user being cau sed to restrict flow 
into the network ingress from each user in accordance with each user's first and 

30 second allocated resource share values, whereby the actual network performance at 
each router is made to converge to the first and second set point values for the 
respective router by automatic admission control adjustments at the network ingress 
routers. 
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In this way, It is passible to \ 
network control loop. Thus in 
commodity market and the operator network may be operated 'm a facility market, Jfdr 
example, the user network control loop may operate to coniraJ 0>S (such as jitter or 
delay), and the operator network control loop may cerate to allocate bandwidth 
resource amongst users. As described below, these set points and the values of the 
willingness to pay and provisioning potential values may be set in accordance with 
policies which may in turn may be related to service level agreements between uiiiers 
and network operators. 



in a second aspect of the invention, there is provided admission control apparatus for a 
switched network having a plurality of routers, the apparatus arranged to record a 
predetermined respective WtP value for each of a plurality of nefcvork users, each of 
the users being coupled to the network via an ingress router, record respective 

15 predetermined set point values for a network performance parameter for each of a 
plurality of routers in the network, and to assign a respective initial price value to each 
router which is associated with the network performance parameter at the router, and 
the apparatus comprising loop control means operable to receive Respective measures 
of actual network performance at each of the routers, calculate tor each router, a 

20 plurality of difference values which are the respective differences between the actual 
performance and the predetermined set point for each router, adjust the price value for 
each router by a predetermined factor based on the respective difference value, 
generate a flow price value for each user of the network by summing the price values 
for each of the routers in the path of the respective user's desired data flow through the 

25 network, allocate a resource share value for each user which represents the value of 
the respective WtP value divided by the respective flow price value, and cause the 
Ingress router for each user to restrict flow into the network ingress from each user in 
accordance with each user's allocated resource share value, whereby the actual 
network performance at each router is made to converge to the se1 point value for the 

30 respective router by automatic admission control adjustments at the network ingress 
router. 
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In a further aspect, there is provided computer software whirii when executed, 
operates to manage resources in a switched network by performing the steps of 
assigning a respective WtP value to each of a plurality of network users, assigning 
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respective set point values for a i 
of routers in the network, 

is associated with the network perfohaance parameter at im operaaa^ ;a : 

first control loop which is operable to receive respective measures of the actual 
network performance at each of the routers, calculate for each router, a plurality of 
difference values which are the respective differences between the actual performance 
and the set point for each router, adjust the price value for eacn router by a factor 
based on the respective difference vaiue, generate a Sow price value for each user by 
summing the price values for each of the routers in the path erf tlie respective .users 
desired data flow through the network, allocate a resource share value for each user 
which represents the value of the respective WtP value divided by the respective flow 
price value, and cause the ingress router for each user to restrict flow into the network 
ingress from each user in accordance with each user's allocated resource share value, 
whereby the actual network performance at each router is made to converge to die set: 
point value for the respective router by automatic admission control adjustments at the 
network ingress routers. 



The invention also provides In another aspect, dynamic resource control network in 
which a network operator controlled entity, rather than the user itself, determines 
20 willingness to pay associated with user traffic, responsive to resource pricing 
information provided from traffic routing nodes in said network. 



in another aspect, the invention provides a method of managing £! dynamic resource 
control network wherein a network operator controlled entity, rather than the user itself, 

25 determines willingness to pay associated with user traffic, responsive to resource 
pricing information provided from traffic routing nodes in said network- 
In an additional aspect, the invention provides software on a machine readable medium 
for managing a dynamic resource control network wherein a network operator 

30 controlled entity, rather than the user Itself, determines willingness to pay associated 
with user traffic, responsive to resource pricing information provided from traffic routing 
nodes in said network. 



35 



It will be appreciated that the term "user" as used herein includes an aggregate of 
users. 



5 



The preferred features may be combined as appropriate^ as would be apparent to a 
skilled person, and may be combined with any of the aspects of the invention. 

5 BRIEF DESCRIPTION OF THE DRAWINGS 

In order to show how the invention may be carried into effect, cimbcdirnents of tfje 

invention are now described below by way of example only and with reference to the ■ , 
accompanying figures in which: > n k 

10 Figure 1 shows a general schematic diagram of a resojurce control system in 
accordance with the present invention; 

Figure 2 shows an example of resource utilisation \n accordance yvith the present 
invention; 

Rgure 3 shows a schematic diagram of a system in accordance with the present 

15 invention; 

Rgure 4 shows a screen capture of a demonstration network of Figure 4; 

Figure 5 shows a more detailed nodes of the network of Figure 4; 

Figure 6 shows a graphical representation of simulation results for the network of 

Figure 4; 

20 Figure 7(a-b) shows a graphical representation of a system in atxordance with the 
present invention; 

Figure 8 is a schematic block diagram of a network having three users and in which 
resource control is controlled by two control loops; 
Figure 9 is a schematic block diagram of the control loops of Rgure 3; and 
25 Figure 10 is a shcematic block diagram of the network of Figure 8 including the control 
loops. 

DETAILED DESCRIPTION OF INVENTION 

30 The following features can be observed when trying to devise parallels between a 
general control system mechanism and network operator/user-aggregate system: 

There is a set point at which the system wishes to hold the output. 
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In general, a control system tries to hoid the output level c$ at jthat specified 

set point 

The system achieves this by Increasing or decreasing, for examfjte, $n intermediate 
variable in a feed back loop. 

If there are multiple components sharing the output, those compcMients get treated 
in an even manner, in a general case. , 

In the network operator/user-aggregate scenario, this is equivalent to: 

The operator wants to set a control level for each class of traffic such that isolation 
between classes are maintained. 

The operator would wish that the control level kept is maintained, in other words the 
given supply is fully consumed. 

The intermediate variable is manipulated according to the difference between the 
supply and how much it is consumed (in other words the demand). This variable is 
usually termed as the resource price. This resource price works as; a forcing function 
that drives an economic system. 



There are always multiple user-aggregates sharing the resource and an even treatment 
to ail of them ensures a particular form of fairness known as proporftanaf fairness. 

The general construction of the exemplary system is shown in Figure 1. A more 
specific example with multiple resources and users will be described below. In Figure 
1 » the parameters are defined as follows: 

Set point for control, resource unit 
Difference variable 
Sample step number 
Gain parameter 

Resource price, price unit for resource unit 

Potential willingness to Pay by the user, Potential willingness to pay unit 
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Yk : Output level, resource Unit i ! - 

(Notes: (1) Ck, Kk, PPk etc need not vary for sample steps. (2) The resource price unit 
could be expressed as price unit per unit resour*^ if the resource pic^ 
5 resource capacity* But then again this has to be rectified tetter in Jthe ensuing 
calculations. Hence this is avoided.), ; v ^ ! 

The difference between the set point and controlled output is gtven by , , : 

Ek = Ck-Yk 

10 

This difference is multiplied by a gain factor and fed to the resource pricing block. 

As the consumption of resource increases, the resource price must go higher and vice 

versa. 

1 5 Hence this gain-difference product is given as a negative input to the pricing block. 

The resource price is later used as the denominator for calculating resource 
consumption. Here it works, for example, as the price to use a common facility (The 
numerator is the potential willingness to pay). 

20 An initial resource price condition (P0) is forced on the system and is taken as unity. 
The resource price is also bounded to upper ami lower limits so as to define an 
operating regime. 

The output of the pricing block is given by 
25 Pk+1 = Pk - KkEk 

The output level Yk is now calculated as 
Yk+1 = PPk+1 / Pk+1 

This is now fed back for sustained operation. 

Multiple resources and user aggregates using different paths: 
30 This is the usual scenario. 

Let the total number of resources be RT and the total number of user aggregates be 

NT (active paths). Then the parameters of interest modifies to incorporate the different 

sets of resources, user aggregates and paths: 

CRk : Set point for control for resource R 
35 ERk : Difference variable for resource R 
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NT 



KRk 





PNk 



PRk 
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RT 



UN 



Number of resources . ^ ? ; 

Resource consumption , by user aggregate N (eg. Flow rate of aeBve; 



path) 
VT 



Number of paths (or combinations) 

Potential willingness to Pay by me user aggregate N 

Output level of resource R 

Resource subset used by user aggregate N 

User aggregate using resource subset R 



PPNk 
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YRk 



RN 



NR 



The equations become: 
ERk = CRk-YRk 
15 PRk+1 = PRk - KRkERk 

If there are NT user aggregates using these resources in VT paths the resource price 
for each user aggregate is calculated as: 
PNk+1 = OPRk+1 , R □ RN 

The resource consumed by user aggregate N is given by. 
20 UNk+1 = PPNk+1 / PNk+1 

The output level is now given as: 
YRk+1 = DUNk+1, N 0 NR 

This summation is an automatic result of resource consumption by different users. This 
value is now fed back for sustained operation. 
25 Scalability: This suggests that the system above is scalable to multiple layers of 
hierarchies. 

Multiple users contributing to a user aggregate: 
This subsection is included for completeness. 



NT 


Total number of user aggregates 


PNk : 


Total resource price for user aggregate N 


UN 


Resource consumption by user aggregate N 


VT 


Total number of paths 


PPNk 


Potential willingness to Pay by the user aggregate N 


n 


Number of users making N user aggregates : 


Pnk 


Price for individual user making up total aggjregafe resource price PNk 
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un User resource consumptiprt making £ggii^&8 ttiflsufflptkm UN ' 

v : Number of indtvkiu^pa^in^i^ V^^ate ffaflis • / f 

PPnk : Potenfial willingness to Pay by userm^cirig u^aagjijgate PPNk 5 
NOn 
5 PNk-OPnk 
UN o un 

VOv :,,!■{... 
PPNk = oPPnk ' ? '■' 

The operation at this level is mainly decided by the; business policy. It may be defined 
1 0 by how individual SLAs are made, how the utilities are assessed 3/kI distributed and/or 
how the individuals are charged. 

PNk and PPNk are parameters in the carrier network level for user aggregates. How 
these are distributed and mapped to the real world customer Nations/economics is a 
15 subject matter not dealt in this paper. It could be a linear or nonlinear relationship as 
decided by various policies. 

An Implementation of the principles outlined has been performed on a real network. 
This used a duster of Linux routers and a set of distributed flows. The model for 
20 demonstration uses three ingress routers, two core routers and four traffic sources for 
generating flows and for introducing disturbance to the network. The model uses a 
distributed three flows scheme. 

This model is sufficient to demonstrate the principles and allows the study of 
25 interactions between the three component flows. 

The lab model for implementation was devised to be compliant with the COPS 
(Common Open Policy Server) Resource Broker model as shown: 

The user polities to be implemented are stored in the Policy Infonration Base (PIB). 
The implementation decisions are made at the Policy Decision Point (POP). These 
policies are then enforced at the Policy Enforcement Points (PEP). The network 
topology and measurement information is stored and collected at the Network 
Information Base (NIB). The benefit to user and revenue to network operator are 
displayed at the Benefit/Revenue Meter (BRM). 



to 

For ease of demonstration and measurement and ^po^rgMif^e^ toe modelfW^ > 
drawn up in the Tklned and appropriate poite 

screen capture of the working system is shown in Figyi^ 4. , ! / 

*. : V 

5 The network is designed around a set of Linux routers and traffic sources and sinks. 

Routers designated 1b, 2c and 1c serve as the tegiBSSj^^ 
of these routers are to be controlled toilMtoi^^f«^^ d^afclo^j^ )^ 
this purpose, the diffeerv CBQ is attached to their output ports. The, comftiaiid Mli 
10 control the bandwidth is given through the traffic control (to) interface of Linux, 

Routers 2a and 2h form the core network. These are the system resources. The output 
bandwidth (resource utilisation) of these routers is set at a specified level (in this case 
6Mbps). The output bandwidth of these routers is to be measured. To achieve this per 
15 class of traffic, the diffeerv CBQ is attached to their output ports as well- The 
measurement is done through the tc command interface. The statistics command 
provide the measurement. 

F!ow1 : Host 1e provides a UDP traffic source that uses co^e router ;2a only. The output 
20 is sunk at the input port of 2h. The ingress controller is 1 b. 

Row2: Host 2g provides a TCP traffic that uses both resources 2a and 2h. The sink is 
1 d. The ingress controller is 2c 

25 Flow3: Host 1h provides a UDP source that uses resource 2h only. The sink is td 
again. The ingress controller is 1c. 

Disturbance: Host 3g is used to generate a traffic pulse so as to create an overflow at 
the core routers, to study the performance and demonstrate the ef Sect Two flows are 
30 generated: D1, that uses both resources and terminates at 1d and D2 that uses onty 
one resource (2a) and terminates at 2h. 

The communication interface is at the moment done through Sish (secured shell) 
access and is planned to be done via remote invocations in the future- 
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Advantageously the software is impjemehied^ pimOjf^'^fl^ 
prototyping. ' ^ 

* ' , /i ',' "i, , 

Only one class of traffic is used in the present demonstration. However, it will be 
5 understood that the system could beusedfor any ctasefffiallia , „ . 

As described earlier, there are thies;4*ser (aggiegai4^^&^ 

shares resourcel, user2 shares both resource! and resourced and users* States 

resource2. 

10 

At start up the system allocates the bandwidth for these user aggregates using an 
initial price. This decision is made at the POP using the algorithm. The bandwidth at the 
resource outputs are now sensed and fed back. This information Is collected at the 
Network Information Base. The algorithm then modifies the allocated bandwidth so as 
1 5 to force optimum utilisation. This is achieved by varying the intemrediate variable that is 
the resource price. The steady state is reached in two sample steps. In the current 
implementation the time step is about one second. 

The graphs on the screen capture shown above (Rg 4) shows the network load 
20 measured via SNMP daemons* The scales have been modified to give better visibility 
and represent about 50 seconds on the x-axis. 

The graph on the left-hand-top (S1) shows the UOP traffic generated. The second 
graph on the same line (11) shows the controlled output. The dip in the flow Is due to 
25 the effect of the disturbance that increases the resource usage suddenly. The 
disturbance flow can be seen in the lower middle (Dl). It may l>e observed that the 
excess UDP flow gets dropped at the ingress router. A mechanism may be employed 
to signal packet drops back to the user for the user to take <x>nedive measures, 
increasing user Potential willingness to pay. 

30 

The lower left-hand graph (S2) shows the TCP flow that is inpu: to the system. The 
second graph on the line (12) shows the controlted flow. It is interesting to note that the 
TCP flow varies itself at the source, since the TCP works underneath the control 
provided by the system. This can be called TCP trunking snd may find great 
35 commercial applications because the network operator can provide preferential 
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treatment to specific edge-differentiated TCP user flow aggregates. | n addltk>n t; ip a 
heterogenous network, TCP delays in the core are not uncqmrften. As the oorttrot is 
performed at the ingress, these delays are avoided. This basically suggests 1 



WHf 

performance can greatly be improved if the control system proposed is overlayed. 

The lower graph on the right-hand side (13) shows another controiifid UDP flow that is : 
input to the system. 



There are two resources with two settable control levels and throe users and flows 
taking three routes. 



The two graphs on the top right-hand ^sSffe C2% m^m0m^^ ''^flfi 
1 0 routers. The sudden rise is due to the disturbance pulse. The bandwidth can be seen to 
be controlled back to the set point very fast The time delays are due to the various 
time lags in the network and system implementation which at the moment are not 
attended to. 

15 It can be seen that the disturbance affects all the ingress controllers. This Is because, 
the disturbance flow passes through both resources. If only one resource is disturbed, 
only the respective resources will be affected. This will reiterate the fact that the 
calculation is not depending on global knowledge. A screen capture of this is not 
included, to save space. (This scenario is better understood in the analysis part where 

20 one can see interactions between various components. This fc explained in the 

simulation section). ( 

An exact model of the demonstration system described above is given above. The 
various constituent blocks are explained earlier in the general model. 



The ingress controller determines the resource prices per user-a<jgregate path, The 
30 controlled flows get combined in the core routers. As a consequtmoe the system is 
inherently distributable and scalable. 



Simulation; 

Results of a matlab simulation are shown in Figure 6. 
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(Plots Flowl, Flow2 & Flow3 corresponds to plots 'n, ^2\^-Mmk,9^^G^m^i^^ 
4). The disturbance flow used is D2,.no*01 (refi Fig2)) . ; : /$h«'-f!'. 

****** ):. ' ' ; r . »v ; .^ 

Step1:Atstep1-the progi^^taite.up.^ i. . .__ .. __ _ vu.- -•- ^,1. -^jf>- 
5 The initial price is unity and PP for all users, is set at 3 unite per unit haiKtwidth. 

From given equations: 

The resource price for each user is 

PN1[1] = PR1[1]~1 

PN2[1] = PR1[1] + PR2[1] = 2 
10 PN3[1] = PR2[1] = 1 

The flow allocated to each user is 

UN1[1] = PPN1[1] / PN1[1J = 3 

UN2[1] ■ PPN2[1] / PN2T.1] ■ 1.5 

UN3[1] = PPN3[1] / PN3[1] = 3 
1 5 The total output at the resources is 

YR1 [11 - UN1 [1] + UN2[1] - 4.5 

YR2[1] = UN2[1] + UN3[1] = 4.5 

Step2: The above usage information is now fed beck to the controller. 

The error signals are 
20 ER1[1]*CR1t1J-YR1[1] = 1.5 

ER2[1] » CR2[1] - YR2H1 = 1.5 

The system now updates the resource prices as 

PR1[2] = PR1fl] - KR1[1]ER1[1] - 0.76> KR1 = 0.16 

PR2[2] = PR2[11- KR2[1]ER2t1] = 0.76, KR2 » 0.16 
25 The resource prices for individual users is 

PN1[2] = PR1t13 = 0.76 

PN2[2J = PR1[2] + PR2[2] = 1.52 

PN3{2]-PR2[2] = 0.76 

The flow allocated to each user is 
30 UN1[2] ■ PPN1 [2] / PN1 [2] = 4 

UN2F21 = PPN2J2] / PN2[2] = 2 

UN3[2] = PPN3I2] / PN3f2] = 4 

The total output at the resources is 
35 YR1 [2] = UN1[2] + UN2[2] = 6 
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VR2J2J ■ UN2[2] * UN3[2J ~ 6 
Features of importance: 
When the system senses that the demand is less than supply, the price is reduced so ; 

that the resources are fully uHh»cjL_-_ ^ »_ . t _ L _. ^, ; 

5 Comparing the utilisation of the netwo* &et*wew step! andstep2 k ^ ' 

YR1[1]- 4,5 units 

YR2t1] = 4.5 units | , ; ^ 

YR1[2] = 6units < ; 

YR2[2]~6 units 
0 There is 33% increase in the usage (here flow). 

. Thus the network gets its set control capacity fully utilised. 

For any resource, for a given sum of PPs, the product of total resource usage and 

resource price remains same In both stepl and step2 and equate ifce sum of PPs far 

that resource. 
15 YR1I1] * PR1[1] = 4.5 = PPN1I11 + PPN2[1] 12 

YR1[2] * PR1[2] - 4.5 = PPNIgJ + PPN2[2] i2 

Comparing the total resource revenue of the network for resource usage between 
stepl and step2 

Total Resource PriceR1R2[1] * PN1I1] + PN2[1] + PN3[11~ 4 unfts 
20 Total Resource PriceRl R2[2] » PN1 [2] + PN2[21 + PN3[21 - 3 unte 

In total the resources fetches one unit less because there was spare capacity supply. 
3, Operator revenue: 

Due to the resource price adjustment mechanism that invites metre traffic, the total 

resource price of the network reduces, white the operator is able to input more traffic 
25 into the network. 

Extra traffic permitted to input at no extra cost 

Extra traffic allowed at resourceRI = YR1I2] - YR1[1] = 1 .5 units 

Extra traffic allowed at resourceR2 = YR2[2] - YR2[1] - 1 -5 units 

If the user is paying a real price per unit share of resource (unit banttwktth in this case); 
30 the extra revenue to the operator from the user can be calculated as follows. CP here 

means the real charged price. (For convenience of calculation, CP is taken as the PP 

of individual users and remains same at both stepl and step2). 

extra revenue from user a (CPIM1[2] * UN1[2] + CPN2I2J * UN2E2] + CPN3[2] * UN3[2I) 

35 (CPN1I1] * UN1[1] + CPN2[1J * UN2[1] + CPti3£1J * UN3[1D 
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= 30 units -22.6 units 21 7.5 unite 
This revenue can then be utilised W m t^m^-U^'^^-mm^ 
individual users according to business strategy etc- t 

4 Fairnessjto userjrafficjlow: Li- _ 

,t may be noted that each user traffic* pays the ^resource pro per re^fGe 

consumed: 

Resource price/ resource for userNi[2] * PPN1I2] / UNIPI = 0.75 
Resource price/ resource for userN2[21 = (PPN2J2J/2 y -O.TO ' .. f 

Resource price/ resource for userNS^ = PPNapi / 

The property observed at step2 suggests that mm®**** * PW^onaily; 
Users of each resource pay equal resource price per resource used. 



J' 

'it* 



It will be noted that at step 10, a disturbance of two units is introduced to resource R1 
(disturbance signal is not plotted). The resource prioe of «1 can toe seen going ttgh 
15 immediately. Flowl and Row2 reduces in a proportional manner «o as to maintan the 
total load at the set point. In other words, when the demand is more than supply, the 
price is increased to force less usage. 

As a consequence of reduction in FlowZ, the resource price of Ri! goes down and lets 
20 in more traffic from Flow3. In other words, when the supply is more than the demand, 
the price is reduced so as to force more usage. 
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The interactions can be clearly seen in the graph. 

The pricing function also drives flow levels to a proportionally fair distribution. 

After a while the disturbance is removed and the resource prices and hence the flows 
regain the previous values. 

The gain factor determines the convergence- It is found that at low levels (say below 
0.16) it is not very sensitive to oscillations and is sufficiently stable. 



The system described above can be used to provide efficient us* of available network 
35 bandwidth, congestion control, providing class isolation and for increasing revenue. 
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Advantages to Carrier Network Operator: * 
A prion global knowledge of other user traffic or Pofen^ ^ft*j«tejtrMP$*gi: 

required. ; 



5 Can be used in any system whew each aggregate path j^ig a> g)vem 

resources) operates as a virtual port (KoowJedge of resources used is Jtffttyj 
available through OSPF, MR£*£F«, ;n ' 

Ubiquitous deployment of the proposed protocol is net required ,fer •sys^=ope%t|W ; 
This is obvious from the demonstration experiment. This facilitates jncremeiital 
deployment. 



Available resource price information can directly be used 
Can assure isolation among classes by keeping the allocated bandwidth 
1 5 Can readily integrate to charging systems 

Tries to fill up the network bandwidth to the allocated central level of the class of traffic 
This increases the revenue to the operator 

Off-line models working on databases can be used as a management tool for impact 
analysis etc 

20 These advantages can be readily examined from the nunieTical exa^rites Qtven earlier. : 
Network utilisation is maximised 

Transport layer protocols (TCP, UDP etc) operate underneath the eontrol provided 
TCP gets controlled at the ingress itself than at the core, tims enhancing the 
performance 

25 Users are treated in a proportional fair manner 

A further advantage of the arrangement is that the method may be implemented 
incrementally over a network to employ the controls described above for the system as 
a whole to operate effectively. However, the specific benefits of tlw present invention 
will have localised effect where it is not applied to the whole network. Greatest overall 

30 benefit is to be obtained when the method is applied throughout the network. 

Any range or device value given herein may be extended or altere d without losing the 
effect sought, as will be apparent to the skilled person for an understanding of the 
teachings herein. 

Referring now to figure 7(a) there is shown a dynamic resource control system 
35 comprising a user (network) providing traffic into a network comprising edge node and 
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core routers. The user also provider Willingness to f|iyi $#SP) parameter -to \& 
network, which is used in admission &mtitA apd/pr bandwkitih ^csffioh >in the edge .'^ ^| 
node. Feedback regarding resource pricing in the network and intended to influence 
adjustment of the WtP parameter is ; |SfM^ ftom the ft$w®& (whether edge xiode^r 
core routers) back to the originating dser / user n^tm^l^ ^plu^h^ ^^"4trals ^adj 
the WtP parameter. 



In contrast in the arrangement of Figure 7(b) them is shown a second arrangement in 
which, instead of feeding bade resource pricing information to the user initiating the 

10 traffic, the feedback is provided to a Network Operator unit (NOWtF) which adjusts the 
WtP associated with the user's traffic. The user has no direct control over ihewtp 
parameter fed to the edge nodes. Instead, the WtP parameter fed to the edge node is 
provided responsive to a service level agreement between the wer and the rietwork 
operator, together wrth any policies which the network operator allies in translating 

1 5 SLAs to WtP parameters. 

Figure 8 shows a development of this idea. Three users 100-1 , 100-2, 100-3 have data 
to send into a network 102. 

20 Each user has an associated willingness to pay parameter W^1 r WtP2 aid WtP3, 
The willingness to pay parameter Is stared in respective service managers 104-1, 104- 
2, 104-3. 

As described above, the WtP may be agreed directly vwth tho user or may be 
25 calculated by a network operator WtP calculator 106 which may have policies 108 
and/or service level agreements 110 as inputs. Taking these inputs, the network 
operator WtP calculator 106 is able to generate a willingness to pay value WtP3b for 
user 3. 

30 The WtP parameter is used in conjunction with the price output irf the contra) loops 
described above (for example in connection with Figure 5) in order to adjust the volume 
of date accepted from each user using ingress (or edge router) control. Typically, this 
control loop would be concerned with monitoring QoS parameters ov the network. 



3 
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In this embodiment, a second cort^ loop/is driNK^rie^ $p ^mfMi^^^ -d^f/k^ 
resources such as bandwidth allocation, ft wflj be aj^e&ated that a treaty loaded 
network (in terms of bandwidth) is ie^BI^ toprov^ t&efe^*tt*^ 
is some inter-relationship between bandwidth aiioeation md <loS* This inter- 
5 relationship is managed by the service managers 104-1 , 104-2, 104-3 which are able to 
control resource allocation by adjusting^ prqviskming parameter PP1, PP2, PP3 which 
is used as the "willingness to pay" input for the second (network) control loop, The 
provisioning parameters are received by network managers tt2-1, 112-2, 112-£,which 
are each associated with a particular user and service manager. 

10 

With reference to Figure 9, the service control loops and nefcvork control loops 
described above are similar in structure to the loop described above* in connection with 
Figure 1. 

15 With particular reference to Figure 9a, it wilt be seen that fee QoS price output of the 
QoS control loop is fed to the service manager. One such control loop is provided for 
each QoS parameter which is to be controlled to a set point Thus, a particular user 
(with reference to Figure 10) such as user 2, who wishes to have a service which 
provides a particular level of QoS parameter 1 and QoS parameter 2, has the QoS 

20 prices summed (in summer 114). This is analogous to the bandwidth control loop 
described above in which a user wishing to use a plurality of routes between a plurality 
of paths between routers has the price for each path summed. Thus, a user wishing to 
have high QoS or control over a large number of QoS parameters wilt require a higher 
WtP value to obtain similar levels of each of those QoS relative to a user which is only 

25 concerned with a small number of QoS parameters. 

Each user service manager 104-1, 104-2, 104-3 operates to dynamically adjust the 
provisioning potential values so that the balance between bandwidth allocation and 
QoS can be met By increasing the provisioning potential values led into the network 
30 control loop, the network control loop is caused to allocate more bandwidth to that user 
thereby facilitating an improvement in QoS. 

For example, if it is found that the convergence of the actual measured QoS 116 
(Figure 9a) with the set point QoS 118 Is very poor, thervone option for the service 
35 managers is to increase the provisioning potential value so that a particular user 
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receives a larger allocation of bandwidth which ir> 1uitv ttjft^ to allow fi* r Q®& v ; 
measured at each router to converge to the sst ^W 1 ^ TO^ foe/^^"- :: < 1 ^ 



managers and network managers periodically negotiate n4s the provisioning potential 
parameter in order to ensure a 
5 QoS. 

Considering Figure 10 in detail, as discussed above, user Z has reached an agtieetfceni 
which covers a requirement for particular levels peifemiance m terms of QoS 
parameter 1 and QoS parameter 2. Thus fire prices are summed in summer 114 
10 before being fed into user 2 service manager 104-2. The other usors 100-1 and 100-3 
have less complicated service level agreements which mean that they are only 
interested in QoS parameter 1 and QoS parameter 2 respectively Thus each of ihetr 
respective service managers is concerned only with the QoS price output from the loop 
of Figure 9a for each of the respective QoS parameters. 

15 

In this example, user 2 is also wishing to send data over the network which uses a path 
which requires the resources which are monitored by resource control loop 1 and 
control loop 2. Thus as discussed above in connection with Figure 5, the price tor the 
two resources is summed in summer 118 which is then used to provide an allocated 
20 resource share value by comparing the summed price with the provisioning potential. 
Users 1 and 3 have data which flows only over a path using resource 1 and resource 2 
respectively. Thus their user network managers 112-1 and 112-3 are concerned only 
with the price output from the resource control loop (Figure 9b) for their respective 
resources. 

25 

It will be appreciated that the embodiment shown in Figure 10 is a very simple 
exemplary embodiment since it is concerned only with two possible QoS parameters, 
three users and only two network routers. In practice, this structure would be very 
much more complicated with many more users, resources and QoS measurements. It 
30 will also be appreciated that a user may for example operate only in the upper plane of 
the diagram having access to a QoS control loop but need not he concerned with the 
lower plane of the diagram in which resources are controlled using the type of control 
shown in Figure 1. 
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Similarly, a user may be conMPi^^G^^tth the ifcsw^ 

in place of provisioning potential values) without being concerned at all with the^S; , - 
controf loop. Thus a "mix and match" approach may be taken to invfen*htation^of fiis 
5 technique. 

Clearly, the full advantages of the technique will be obtained wheil the whole network 
has all users being provided with QoS and resource control loop operation. The H mix 
and match 11 approach is possible because it is not necessary to. have detailed; 

10 information about other users. Interaction between uaera occurs only via a pric& value. 
The price value itself is calculated by measurements at the router, Thus users may 
pass data through a router without having any interaction with the dynamic resource 
control technique of this invention. In this case what happens is that this type of user 
degrades QoS and user resources which this technique cannot control. However this 

1 5 degradation and use of resources is reflected by the direct measurements carried out 
in the control loops and is in turn reflected by a higher price for that QoS parameter or 
bandwidth allocation. 

Thus it will be seen that the technique above provides a computationally simple and 
20 readily scaieabie technique for providing particular QoS and also for balancing 
bandwidth n and fine control may therefore be had over QoS offered to users. 

This technique is applicable to any data network transport protocol, for example, UDP 
or TCP/IP. it is also applicable to optical networks since it will be appreciated that if the 
25 resource control loop is operated very strictly to prevent network overload, buffering 
within the network is not required. This is a consequence both of the fine control over 
network utilisation and of the fact that control occurs at the ingress. 
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